Cost Vs Credibility: How Much
نویسنده
چکیده
This paper addresses the perennial issue, "How much V&V is enough for an accreditation?" or, perhaps more to the point, "How much do you have to spend to convince someone that your model is any good?". The answer is discussed in terms of our experience in providing accreditation support for weapons system programs within the Department of Defense (DoD). We begin by describing an integrated V&V process developed by the SMART Project, both in overview and in detailed Work Breakdown Structure (WBS) form. We then describe how V&V tasking over the life of the project was tracked and related to WBS elements, and how average costs of each V&V task and product were developed. A table showing levels of effort (LOEs) and fully loaded costs for each phase of V&V is also presented. The V&V process is then embedded within the context of a five-step accreditation support mechanism, whose focus is on the development of application specific M&S acceptance criteria prior to setting V&V requirements. By relating V&V requirements to objective acceptance criteria, and by structuring the accreditation plan around these requirements, precious V&V resources are not wasted chasing unneeded V&V products. The paper concludes by demonstrating that the cost of establishing M&S credibility is governed by two factors: (1) development of unambiguous M&S acceptance criteria prior to V&V, and (2) the availability of prior V&V results. Absent either of these two factors the cost of accreditation must rise substantially, either due to overscoping of the V&V effort, or to lack of synergism between current and prior accreditation efforts, or both.
منابع مشابه
How Much Can We Save the Cost from Shifting from Single - Test Strip to Multiple - Test Strip in Point of Care Testing Analysis for Common Clinical Chemistry Parameters ?
متن کامل
Announcements and Credibility under Inflation Targeting
We inspect how inflation target announcements are instrumental in building central bank credibility and shaping the public’s inflation expectations. Investigating the role of announcements in two early adopters of inflation targeting by using a time varying credibility measure, we find that both the accuracy and the frequency of inflation announcements have a positive impact on how much attenti...
متن کاملIZA Discussion Paper No. 144
Flexibility vs. Rigidity: Does Spain have the worst of both Worlds? In this paper we study the structure of labor market flows in Spain and compare them with France and the US. We characterize a number of empirical regularities and stylized facts. One striking result is that the job finding rate is slightly higher than in France, while the jon loss rate is much higher, putting Spain half-way be...
متن کاملBelieve it or not: Factors influencing credibility on the Web
This article reviews selected literature related to the credibility of information, including (1) the general markers of credibility, and how different source, message and receiver characteristics affect people’s perceptions of information; (2) the impact of information medium on the assessment of credibility; and (3) the assessment of credibility in the context of information presented on the ...
متن کاملEmpirical Bayesian Credibility for Workers’ Compensation Classification Ratemaking
This paper demonstrates how a company can derive accurate classification relativities. The method uses an empirical Bay&an credibility formula as taken from the paper " Credibility for Loss Ratios " by Buhl-mann and St*,tub and modified by the IS0 Credibility Subcommittee. The data rc Ittired for this method can be purchased from the National Council. A classification review is performed on thr...
متن کامل